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ACOUSTIC ECHO CONTROL SYSTEM AND DOUBLE TALK CONTROL METHOD 
THEREOF 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[011 The present invention relates to an acoustic control system and a 
double talk control method thereof, and more particularly to an acoustic echo control 
system and a double talk control method thereof for inten-upting an operation of an 
adaptive filter for removing acoustic echoes in a double talk by detecting a double 
talk and a change of an echo path without time delay 

Description of the Prior Art 

[021 A hand-free communication system which does not apply a hand-set Is 
applied to various fields such as a teleconference system, a speaker phone, etc. in 
order to promote convenience and stability of a speaker. Further in some countries, 
telephones installed in vehicles should legally follow the hand-free communication 

system for traffic safety. 

[03] However, in the hand-free communication system, acoustic echoes 
are generated though a path among a speaker, a space wherein a speaker is 
located and a microphone and thus communication quality is deteriorated. 
Accordingly, there is required an acoustic echo control system that removes the 
acoustic echoes. An echo controller which applies an echo removing system solves 
a half-duplex communication, the problem of an echo controller which applies an 
echo suppression system, and thus a full-duplex communication becomes possible 
with that controller. 

[043 In addition, since characteristics of the acoustic echoes are varied in 
accordance with a time change, the acoustic echo control system applies an 
adaptive digital filter and differently operates in accordance with a communication 
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condition. Specifically, since coefficient radiation may be incurred wlien performing 
coefficient adaption of the adaptive digital filter in a double tall< section in which 
speakers simultaneously talk, a double talk detecting operation is required to 
prevent the coefficient radiation. 

[05] To remove such echoes, although the adaptive digital filler is applied, 
the filter coefficient radiation in the double talk should be prevented. Accordingly, in 
order to achieve the double talk detection which is required according to the 
necessity of preventing the coefficient radiation, there has been introduced a 
method which applies a method of comparing sizes of signals and a method of 
using correlation. 

[06] An echo path may changed due to increase of a speaker volume, 
movement of the speaker or door opening/closing. However, with the above 
methods the double talk can be detected, but the double talk generation and the 
echo path change can not be distinguished. Furthermore, the above methods have 
a tendency to stick to an operation system which is not suitable for the acoustic 

echo control system. 

[071 For example, according to U.S. patent No. 5.136.577, there is 
introduced a method, suitable for the acoustic echo controller, which is capable of 
adapting a filter coefficient and discriminating the change of the double talk from the 
change of the echo channel. The above method applies a value of echo return loss 

enhancement (ERLE). 

[081 However, the problem of the conventional method is that since the 
value of ERLE is changed even in accordance with size of an input signal, when an 
actual signal is applied, an erroneous detection of double talk may be caused by 
which the value of ERLE is frequently changed although there is no change of the 
double talk or the echo channel. Thus, the conventional method is not suitable to be 
embodied into an actual system. 
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SUMMARY OF THE INVENTION 

[091 The first object of the present invention is to provide an acoustic echo 
control system and a double talk control method thereof that eliminate acoustic 
echoes when using a hand-free telephone. 

(101 The second object of the present invention is to provide an acoustic 
echo control system and a double talk control method thereof that provides a high- 
quality telephone communication by which a double talk generation and a change of 
an echo path are detected on the basis of signals from a near end talker and a far 
end talker, thereby suspending a filter coefficient adaption operation of an adaptive 
echo remover when detecting the double talk state and performing the filter 
coefficient adaption operation when the each path is changed. 

[11] The third object of the present invention is to provide an acoustic echo 
control system and a double talk control method thereof that discriminates a double 
talk state and a change of an echo path without time delay. 

[12] To achieve the objects of the present invention, there is provided an 
acoustic echo control system which includes an adaptive echo remover estimating 
an echo signal con-esponding to a far end signal of a far end talker, thus generating 
the echo signal, a double talk detecting unit detecting a double talk state on the 
basis of a near end signal of a near end talker, the far end signal and the echo 
signal and a controller suspending an operation of the adaptive echo remover In the 
double talk state in accordance with an output signal from the double talk detecting 
unit. 

[13] In the acoustic echo control system, the double talk detecting unit 
includes a double talk detecting prediction unit receiving the near end signal in 
which a near end talker signal is mixed with an echo signal in accordance with the 
far end signal of the far end talker and computing a reflection coefficient variation 
which Indicates a characteristic of a sound signal, a threshold value determining 
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lattice prediction unit receiving the near end signal and estimating a reflection 
coefficient variation with respect to the far end signal using the reflection coefficient 
of the sound signal, thereby computing a threshold value for the double talK 
detection and a double talk determining unit receiving and comparing output signals 
from the double talk detecting and threshold value determining lattice prediction 
units and accordingly determining the double talk state. 

[14] Further, to achieve the objects of the present invention, there is 
provided a double talk control method of an acoustic echo control system which 
includes the steps of computing a reflection coefficient variation of a far end signal 
from a far end talker and a reflection coefficient variation of a near end signal in 
which a near end talker signal and an echo signal in accordance with the far end 
signal are compounded, computing a threshold value for detecting a double talk 
state from the reflection coefficient variation of the far end signal, comparing the 
threshold value and the reflection coefficient variation of the near end signal, and 
suspending a filter coefficient adapting operation of an adaptive echo remover which 
generates an estimated echo signal from the echo signal when ttie reflection 
coefTicient variation of the near end signal is larger than the threshold value, or 
eliminating the echo signals by adapting filter coefficients when the reflection 
coefficient variation is not larger than the threshold value. 

[15] Also, there is provided a double talk detecting method of an acoustic 
echo control system, which includes the steps of computing a reflection coefficient 
variation of a far end signal from a far end talker and a reflection coefficient variation 
of a near end signal in which a near end talker signal and an echo signal in 
accordance with the far end signal are compounded, computing a threshold value 
for detecting a double talk state from the reflection coefficient variation of the far end 
signal, comparing the threshold value and the reflection coefficient variation of the 
near end signal and, when the reflection coefficient variation of the near end signal 
is larger than the threshold value, determining that a double talk is generated and 
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detecting the double talk. 

[16] It is to be understood that both the foregoing general description and 
the following detailed description are exemplary and explanatory and are intended 
to provide and further explanation of the Invention as claimed. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[171 The accompanying drawings, which are included to provide a further . 
understanding of the invention and are incorporated in and constitute a part of this 
specification, illustrate embodiments of the invention and together with the 
description serve to explain the principles of the invention. 

[18] In the drawings: 

Fig. 1 is a schematic block diagram of an acoustic echo control system 
according to an embodiment of the present Invention; and 

Fig. 2 is a detail block diagram of a double talk detector in Fig. 1 according to 
an embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[19] Reference will now be made in detail to the preferred embodiment of 
the present invention, an example of which is illustrated in the accompanying 
drawings. 

[20] Fig. 1 is a schematic block diagram of an acoustic echo control system 
according to a preferred embodiment of the present invention. In Fig. 1. an acoustic 
echo control system 1 is provided between a microphone 40 for receiving a voice 
from a near end talker (NET) and a speaker 30 for transmitting a signal from a far 
end talker (FET) to the NET. The acoustic echo control system 1 outputs a near end 
signal outputted from the microphone 40 as a signal Sout which will be transmitted 
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to the FET and transmits a signal outputted from the FET over the speaker 30 to the 
NET. The acoustic echo control system 1 eliminates a FET signal since the FET 
signal is transmitted to the NET over the speaker 30 and may be inputted to the 
microphone 40 and return to the FET. 

[21] Now. the detail description of the acoustic echo control system 1 
according to the present invention will be made. 

122] AS shown In Fig. 1 . the acoustic echo control system 1 includes a 
receiving terminal loss unit 10. an adaptive echo remover 20. a subtracter 50. a 
transmitting terminal voice activity detector 60, a receiving terminal voice activity 
detector 70, a double talk detector 80. a transmitting terminal loss unit 100, a 
howling controller 110, a center clipper 120. an optimum noise generator 130. an 
adder 140 and a controller 90. all operatively coupled. 

123] To describe the operation of the system 1 . first a signal from the FET is 
inputted to the receiving terminal loss unit 10 and the receiving terminal voice 
activity detector 70. respectively. A FET signal x(n) from the FET is supplied to the 
adaptive echo remover 20 over the receiving terminal loss unit 10. and converted to 
an analog signal by a digital to analog converter (not shown) and transmitted to the 
speaker 30. 

[241 The adaptive echo remover 20 estimates an actual echo signal from a 
FET signal x'(n) which is supplied thereto over the receiving terminal loss unit 10 by 
adapting to a coefficient of an internal adaptive filter and supplies an estimated echo 
signal (y) to an inversion terminal (-) of the subtracter 50. 

[25] The echo signal (y). which has been estimated in accordance with the 
FET signal x'(n) and transmitted over the speaker 30 to an indoor space, is 
transmitted to the NET and may return to the FET over the microphone 40. Here, an 
input signal from the NET and the echo signal (y) are digitalized by an analog to 
digital converter (not shown), and a signal Into which the two signals are mixed Is a 
near end signal z(n) which is inputted to a non-inversion temninal {+) of the 
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subtracter 50 and the subtracter 50 outputs a residuary echo signal (e) by 
subtracting the echo signal (y) which is estimated In the adaptive echo remover 20 
from the near end signal z(n) supplied from the microphone 40. 

[26] The transmitting terminal voice activity detector 60 receives the near 
end signal 2(n) and the residuary echo signal (e) from the subtracter 50. 
respectively, and determines whether there exist the near end signal and. residuary 
echo signal and supplies a resultant to the controller 90. Also, the receiving terminal 
voice activity detector 70 informs the controller 90 whether there Is any signal 

supplied from the FET. 

[27] In a double talk section in which the FET and the NET simultaneously 
talk, due to the double talk, a near end signal in accordance with the NET is 
additionally included to the residuary echo signal (e) of which the echo according to 
the FET signal is removed, thus a filter coefficient of the adaptive echo remover 20 
is destroyed. Accordingly, it Is an important feature to have the double talk detector 
80 which detects the double talk and infomis the controller 90. 

pal When the double talk is detected in the double talk detector 80, the 
controller 90 first controls the adaptive echo remover 20 to suspend the adaption of 
the adaptive filer coefficient since the near end signal is included in the residuary 
echo signal (e) and controls the other components, thus the talk is being continued. 
The details of the double talk detector 80 will be later described. 

[29] The transmitting terminal loss unit 100 gives an adequate loss to a 
transmitting terminal in accordance with the control of the controller 90. the howling 
controller 110 detects and controls a howling in accordance with the control 
operation of the controller 90. and the center clipper 120 removes the echo signal 
which has not been completely removed by the adaptive echo remover 20 by 
performing a center clipping operation and outputs a signal in which the echo signal 
is removed to the adder 140. Then, the adder 140 outputs a signal Sout by 
compounding the signal in which the echo signal has been completely removed by 
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the center clipper 120 and a surrounding noise supplied from the optimum noise 
generator 1 30. 

[30] With reference to Fig. 2. the double talk detector 80 will be described 
in detail. 

[31] The double talk detector 80 according to an embodiment of the 
present invention includes a double talk detecting lattice prediction unit 82 for 
detecting a double talk by responding to the near end signal z{n} for which the NET 
signal and the echo signal (y) are compounded by the microphone 40. a threshold 
value determining lattice prediction unit 81 for computing a threshold value for 
detecting the double talk by responding to an input signal from the FET and a 
double talk determining unit 83 for determining a change of the double talk and echo 
path by receiving output signals from the lattice prediction units 81 . 82. 

[32] The operation of the double talk detector 80 will be explained as 
follows. The near end signal z(n) in accordance with the double talk further includes 
a signal a statistic character of which is utterly different from the dlgitalized echo 
signal y(n). In addition, since the signal from the NET has a higher level than the 
echo signal y(n), the statistic character thereof is greatly changed when the NET 
signal is commenced, thereby the detector 80 receives the near end signal z(n) and 
a variation of a reflection coefficient of the double talk grid prediction unit 82 
becomes larger. 

[33] When a talker increases a speaker volume or makes a move, or when 
a door Is closed/opened, the echo path may be changed. Since the change of the 
statistic character Is minute, the variation of the reflection coefficient of theses cases 
becomes smaller than that of the double talk. However, since the reflection 
coefficient Is varied in the case where the echo path is changed, to prevent this case 
from being considered as the double talk case, the double talk detector 80 estimates 
a reflection coefficient variation D,(n), as shown in Equation (1). and compares the 
same to a selected threshold value, for thereby determining whether the variation 
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corresponds to the double talk or to the change of the echo path. 



[34] Equation (1 ) 



D^(n) = ^ p xlOO 

/'•I 



[35] In Equation (1). in the grid prediction unit of a pth degree, r is a 
degree in which there is a reflection coefficient having an effective value. K is a 
parameter having a characteristic of a voice signal, wherein Ki{n) is a reflection 
coefficient in a discrete time n and Ki(n-T) is a reflection coefficient from the time n 
to a sample T. 

[361 The reflection coefficient variation Dx(n) unexpectedly becomes larger 
when the double talk is generated. However, if value is greatly varied although the 
echo path is changed, as described above, the double talk detector 80 considers 
that case as the double talk and thus suspends the adaptation of the filter 
coefficient. The above problem can be settled from the following consideration. 

[37] The echo path is changed in the acoustic echo control system, when 
the talker increases the speaker volume or makes a move, or when the door is 
closed/opened. Since the statistic character of the near end signal z(n) from the 
NET is not varied, the reflection coefficient variation Dz(n) is little changed. 

[38] In addition, when there is any change of surrounding environment, the 
statistic character of the near end signal is changed in a corresponding section of 
the echo path, thus the change of the statistic character thereof is much smaller 
than the case where the signal from the NET is commenced. 

[39] However, the reflection coefficient variation Dz(n) may increase 
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although a statistic character of the FET signal )<(n) from the FET is changed, that is 
when a statistic character between neighboring phonemes is drastically changed. 
Thus, by providing a grid prediction unit corresponding to the FET signal x(n), the 
information of change of the FET signal characteristic can be obtained. 

(401 When a reflection coefficient variation to the FET signal x(n) is 
expressed in Dx(n), the operation of the double talk detector 80 according to the 
present invention is as follows. (1) first, the threshold value determining grid 
prediction unit 81 computes the reflection coefficient variation DK(n) with respect to 

the FET signal x{n)- 

[411 (2) From the computation result of the reflection coefficient variation 
Dx(n). the threshold value determining grid prediction unit 81 computes a threshold 
value Dm(n) in order to detect a double talk therefrom. Here, the threshold value 
Dth(n) is computed by an Equation (2) as follows. 

[42J Dth(n) = / X max {D),(n-C). Dx[n-(C+1 )] Dx(n-M)} (2) 

[43] Wherein, / is a constant. C is a value which time delay due to a direct 
path of the echo path is considered and M is a range of a previous value which is 
under consideration for effects of the indoor space. Further, y Is larger than 1 and 
should be set up considering an echo signal-to-noise ratio, because when / is a 
small value, the double talk is detected sensitively but the change of the statistic 
character of the sound signal might be determined as the double talk. 

[441 (3) At this time, the double talk detecting grid prediction unit 82 
computes the reflection coefficient variation D.(n) with respect to the near end signal 
z(n). 

1451 (4) The threshold value determining grid prediction unit 81 and the 
double talk detecUng grid prediction unit 82 output a threshold value Dth(n) 
corresponding to the FET signal x(n) and the reflection coefficient variation Dz(n). 

10 



PAGE 30144 * RCVD AT 10/27/2004 3:35:47 PM [Eastern Daylight-Time] * SVR:USPT0-EFXRF-1/5 * DNIS:8729306 * CSID:703 205 8050 * DURATION (inin^):12-20 



OCT-27-2004 WED 03:36 PM BSKB FAX NO. 703 205 8050 



SUBSTITUTE SPECIFICATION 
U.S. A|>pl. No. 09/100,946 
Aliv, Dfickct No. 0630.0820P 



respectively, to the double talk determining unit 83. 

[461 (5) double talk detemnining unit 83 compares the two 

inputted values therefrom. When the reflection coefficient variation Dz(n) with 
respect to the . near end signal z(n) is larger than the threshold value Dth(n) 
corresponding to the FET signal x(n). the unit 83 detenriines it is a double talk state, 
while when the reflection coefficient variation Dz(n) with respect to the near end 
signal 2(n) is smaller than the threshold value Dth(n) corresponding to the FET 
signal x(n). the determines that it is not the double talk state, and the double talk 
determining unit 83 supplies a resultant signal thereof to the controller 90. 

[47] (6) Thus, the controller 90 controls the adaptive echo renrover 20 to 
suspend the adapting operation of the adaptive filter coefficient in the double talk 
state or continually performing the adapting operation thereof when it is not the 
double talk state. 

[481 If there exists only the echo signal in accordance with the signal 
outputted from the FET. the echo signal can be eliminated by the adaptive echo 
remover 20, thus telephone communication quality is guaranteed and also in the 
change of the echo path the echo signal can be eliminated by the operation of the 
echo remover 20. When the double talk state is detected in the double talk detector 
80, the telephone communication maintains in a situation which the operation of the 
adaptive echo remover 20 Is suspended and in this period the adaptive echo 
remover 20 is prevented from emitting filter coefficients. 

(491 With the above-described operation, the double talk and the change of 
the each path can be distinguished without time delay, and since the double talk is 
detected using the near end signal, the detecting operation is performed much 
faster than the conventional art. Also, the present invention can be applied to a long- 
distance call as well-as the hand-free communication system. 

[501 As described above, the acoustic echo control system according to the 
present invention accurately detects the double talk section and the change of the 

11 
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each path using the grid prediction unit and In the double talk section which is 
detected prevents the adaptive echo remover from performing the filter coefficient 
adaption, thereby improving telephone communication quality. Further, when the 
echo path is changed, the filter coefficient adaption is performed without time delay 
and thus the echo signal is promptly eliminated. 

[S11 It will be apparent to those skilled In the art that various modifications 
and variations can be made in the acoustic echo control system and the double talk 
control method thereof of the present invention without departing frorn the spirit or 
scope of the invention. Thus, it is intended that the present invention cover the 
modifications and variations of this invention provided they come within the scope of 
the appended claims and their equivalents. 
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